Apache Parquet Official Native Rust Implementation

This crate contains the official Native Rust implementation of Apache Parquet, which is part of the Apache Arrow project.

Example

Example usage of reading data:

use std::fs::File;
use std::path::Path;
use parquet::file::reader::{FileReader, SerializedFileReader};

let file = File::open(&Path::new("/path/to/file")).unwrap();
let reader = SerializedFileReader::new(file).unwrap();
let mut iter = reader.get_row_iter(None).unwrap();
while let Some(record) = iter.next() {
    println!("{}", record);
}

For an example of reading to Arrow arrays, please see here

See crate documentation for the full API.

Rust Version Compatbility

This crate is tested with the latest stable version of Rust. We do not currrently test against other, older versions of the Rust compiler.

Supported Parquet Version

• Parquet-format 4.0.0

To update Parquet format to a newer version, check if parquet-format version is available. Then simply update version of parquet-format crate in Cargo.toml.

Features

• All encodings supported
• All compression codecs supported
• Read support
  • Primitive column value readers
  • Row record reader
  • Arrow record reader
• Statistics support
• Write support
  • Primitive column value writers
  • Row record writer
  • Arrow record writer
• Predicate pushdown
• Parquet format 4.0.0 support

License

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0.